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Abstract 
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1 Introduction 



In the present paper, we study orbital stability of solitary wave solutions for the three coupled long 
wave-short wave interaction (LSI) equations 



(1.1) 



+ <t>xx = f3w(j>, 

wt = m\^ + m')x, 

where i/j : R x 1R+ ^ C, w : R x R+ ^ R, /3 is a real constant. Here w represents a long wave mode, 
and (j) and ip denote short wave modes propagating in a continuous medium. This system describes the 
resonant interaction among two short wave modes with equal group speeds and one long wave mode 
whose phase speed is equal to the group speed of short waves. System (II. ip appears, for instance, in 
water waves [J [2] and in a bulk elastic medium [3] . In a recent study g] , it is shown that system (jl.ip 
has a two-parameter family of solitary wave solutions of the form 

tps{x,t) = *(a; - ct)e^'^*, 
Ws{x, t) — W{x — ct), 

where 14^(2;) = -/3(|$(x)p + |«'(a;)n/c, ($(a;), ^(x)) = (i?i(j;), i?2(a;))eT^, c > and 4cj - > 0. 
Here W E L'^{M.) and (i?i,i?2) e H^{R.) x H^{R) are positive solutions of 



(1.2) 



c2 /32 

Uxx + {(^- —)u (u^ + v'^)u = 0, 

4 c 

■2 



-Vxx + (w —)v (m^ + v'^)v ~ 0. 



(1.3) 



.2 

? c 

System (jl.ip is a generalization of the two component long wave-short wave interaction system given by 



(1.4) 



i(j>t + 4>xx = Pw(j), 

Wt = l^i\(l}\'^)x- 

System (|1.4p was derived to describe the resonant interaction of a short wave, (/>, and a long wave, w, 
propagating on the surface of water [5] . The same system was also obtained for the resonant interaction 
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of internal gravity waves [5]. In [7], orbital stability of solitary wave solutions of the two component 
system (|1.4p was considered and it was observed that the solitary waves of the form 

(l>{x, t) = R{x - ct) e"^*+*f w{x, t) = W{x - ct), 

where {R,W) G H^{R) x £^(R), arc orbitally stable when c > and 4cj - > 0. In that study, a 
Lyapunov functional, whose critical point is the solitary wave solution of p.4p . was constructed using the 
conserved quantities of the system. It was shown that the stability of solitary waves relied on suitable 
lower and upper bounds on the variation of the Lyapunov functional. This method has been developed 
in [5] to prove the stability of solitary waves of the Korteweg -de Vries equation. In a later study [5], 
the same method has been used to show the stability of standing waves of the Nonlinear Schrodinger 
equation, which has been already proved in [lOj using the concentration-compactness methods. In the 
present paper, we prove that solitary waves p.2p are orbitally stable for the LSI system (jl.ip when c > 
and Alu — > 0, using a variational method, the so-called Lyapunov method. 

The organization of the paper is as follows: The local wcU-posedness of the Cauchy problem for 
(jl.ip is discussed, and conserved integrals for the same system is given in section 2. A variational 
characterization of the solitary waves, which will be used in the proof of the stability of solitary wave 
solutions, is briefly presented in section 3. We state the stability theorem that relies on a lower bound 
of the second variation of the Lyapunov functional in section 4. Using the analysis of the unconstrained 
variational problem carried out in [T, the lower bound is proved and the stability of solitary waves is 
established in the same section. 

Notations. Throughout the paper LP(R), 1 < p < oo, represents the space of p— integrable functions. 
Il/llp denotes the LP{R) norm of /, 1 < p < oo. H^{R) = W^^'^{M.) is the Sobolev space of / for which 
the norm ||/||^i = II/II2 + ll^/lli finite. (/, 5) refers to the inner product of / and g in _L^(M). 
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2 Local Well-Posedness of Cauchy Problem 

The Cauchy problem for the two component LSI system (|1.4p was studied in [TT] for initial data {(j)Q, wq) G 
i?^/^(R) X L^(R). A contraction technique was used to prove existence and uniqueness of solutions of the 
initial value problem in suitable Banach spaces. Conservation of energy and masses were used to extend 
the local solution globally. Later, the local-well-posedness result for (|1.4p was improved in [T2] for initial 
data {(1)0, Wo) G H''{M.) x < fc < 1/2. The Cauchy problem for the three component LSI 

system was considered in :13^ for initial data (0o, '0o, wq) G H'^/^{R) x H^/^{R) x L'^{R). Following 
the ideas of |llj, the local-well-posedness theory was established in the same study. In the present 
section, the local well-posedness of the Cauchy problem for which is necessary in the study of 

stability of solitary waves, will be presented briefly. 

For the three component LSI system, the Cauchy problem 



«0t + 't'xx = F^{(f>,i>) 

(/)(x,0) = (?!)o(x), 'ip{x,<d) = i)o{x) 

was considered in [T^ , where 



(2.1) 



(F^, F^) mx, s)|2 + \^{x, s)|2),ds + pwo{x) I (0(x, t), yj{x, t)). 







Here ((/)o, -00, wq) G H^/'^{R) x H^/^{M.) x L'^{R). Following [IT], a fixed point method was used to prove 
existence and uniqueness of local in time solutions. First, the Cauchy problem (|2.ip was written as a 
coupled system of integral equations 

0(t) = Ji(0, 0) = Uit)Mx) -^}u{t~ s)F^{c^{s), i;is))ds 





0(0 = J2(0, 0) = Uit)Mx) -^!U{t- s)F^i^{s), 0(s))ds, 





(2.2) 



where U{t) = e**o^ is the Schrodinger linear group. Similar to that of [TT|, the function space was 
defined by 

X^ = {f: [0,T] X C|/ e C([0,T];i/i/2(R)), e L°-{R; L^[0,T])}, 



and endowed with the norm 



) 



1/2 



WfWxT 



0<t<T R 



sup |l/(.,t)||i/i/2 +sup 








Thus ((/), ip) £ Y'^ = X for which the norm was defined as 



||(0,V)||yT ^ MxT + UWx^- 



(2.3) 



A ball of radius R > was defined as Bb = {(</>, V') G Y'^ '■ ll^llx^ + ll^llx^ 1^ R}- Using smoothing 
effects estimates (Lemmas 1-3 in [11]) obtained in [14j|T5] and Lemmas 4-5 in [11], the norm of ^'(0, V') = 
(^1,^2) in was calculated to show ^I' : Br Br: 



\\^{<P,n\YT = ||Jl(^,^)|ix- + ||J2(0,^/')||x- 

< Ci||0o||ffi/2 + + Ki{T){\\4>\\\^ 

+\m\T + + K2{T)m\\T + ii^iix- + i)iiv'iix- 
+K{T)m\. + ufxT + mmxT + uwxt). 

Here C = max{Ci, C2} is a positive constant, K{T) = max{ifi(T), K2{T)} and ii:(T) as T 0. 
i? was chosen so as to C(||</)o||//i/2 + || lAollHi/a) < R/2. Then for fixed i? > 0, small T was taken to 
ensure K{T){m^ + 2R) < R/2. This led to 



For uniqueness of the fixed point, in a similar way, the norm of ^(0i, ?/;i)(t) — ^(02, '/'2)(^) in 



\\-^icf,,^)\\YT <R. 
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was calculated: 

+ 1^2(01,-01) - J2(02,'02)|U^ 
<H,{T){\\MIt + U2\\It + Ui\\],t 
+ IIV'2|li-T +1) 1101 -02||XT 
+ i/2(T)(|l^l||^. + ||^2|li-T + ||0l||i.. 
+ Il02|lx-+I)ll^l-'A2|| 

< H{T)iAR^ + 1)11(01 - 02,7^1 - V2)||yT, 

where H{T) ~ ma,x{Hi{T), H2{T)} and H{T) — > as T — > 0. T was chosen as a small quantity so that 
H{T){4:E? + 1) < 1. It was concluded in [13] that \E'(0, -0) was a contraction on Bn and (0, "0) was the 
unique solution of ()2.2p . i.e. the local well-posedness of the Cauchy problem for (|1.1|) was established: 

Theorem Let (00,-00) e H^/'^{M.) x i/2(r) and wo € L2(R)nL°°(M). There exists a unique solution 
{(j){x,t),'4>{x,t)) of the Cauchy problem on [0,T] for T > such that e C ([0, T]; ^^/^(R)) , 

0^ e (M;i2[o,T]), C([0,r];ffi/2(K)) and e L°° (M;L2[o,r]). 

The conserved integrals of the LSI system (jl.ip are of the form [TB] 

Ji = y |0|2 dx, h= j IV-I' da^, 

R K 
/3 = y h' + «(0*0:r - 00* + i^*i'x " l/'V'*)] 

/4 = y [|0.P + |V.P+/3(|0P + |^nH dx, (2.4) 

where /i and I2 are the mass functionals, is the momentum functional and 1^ is the energy functional, 
i.e. the Hamiltonian. As the natural energy space for the LSI system (|l.ip is H^{R) x i7^(R) x i^(K), 
the initial data is taken as (0o,0'o,'Wo) G i/"'^(M) x H^{S) x i^(R) in the present study. 
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3 Variational Characterization of Solitary Waves 

In this section we briefly discuss a variational characterization of solutions for (|1.3p . considered in [1], 
where the stability analysis of solitary waves is based on. 
Motivated by Nagy inequality [T7] given as 

where q, f3 > 0, p > 1, s = 1 + q{p - l)/p, H{a, h) = [[a + 6)-("+'')r(l + a + 6)]/[a-''6-'T(l + a)T{l + b)] 
and r is the Gamma function, and by Gagliardo-Nirenberg inequality 

||u||.<C||Vu||^ llwlli-", 0<^9<1, u^H\W^) 

where § = n(l/2 — 1/r); the nonhncar functional J{u,v) on H^{R) x iJ^(R) 

II 2^ 2||l/2 ' ^=4' ^^-2) 

11"" + I' II 2 

was considered in The functional J{u,v) is well defined on H^{M.) x due to embedding of 

i/^(M) in _L^(R). It should be pointed out that the nonlinear functional J{u,v) is a generalization of 
the single variable functional J{u) which was considered in the study of standing waves of the nonlinear 
Schrodinger equation [18j . 

The first variation of the nonlinear functional J{u, v) is given as 

5J = —B j {\uxx ~ + ^{u^ + v^)u]rii + [vxx — + ^{u^ + v'^)v\rj2} dx, 

R 

where ry, G Co°°(M) (i = 1,2), n = uj - c^/A and 7 = /3Vc, B = [33/(4"^^ + v'^ fdxf))^''^, 

R 

and the Pohozaev type identities, 

,2 I „.2\ 7^ _ o / /'„,2 , „,2n 7 _ 37 1 2 I „.2n2. 



3 j {ui + vi)dx y + ^ )'^^ =4 7 + w^)^da;, (3.3) 

R R R 

satisfied by (u, v) are used. It is shown in [4] that the infimum of J{u, v) is achieved at a pair of positive 
functions (i?i, R2) when c > and 4w — > using Lieb's compactness lemma. Thus the critical points 
of the functional J{u,v) in H^{M.) x H^{M.) are the non-trivial weak solutions of (|1.3p . As will be seen 



in section 4, the variational characterization plays a key role in the stability analysis of solitary waves 

It should be noted that there are various studies in the literature devoted to the problem of existence 
of solutions of the coupled system (|1.3p and its generalizations ( |19|, [20j and the references therein). 
In those studies, variational approaches based on minimization of energy functionals subject to some 
constraints are used. Though the approach followed in [1] is different from those of [IHllinij it is readily 
seen that minimizing the energy functional is equivalent to minimizing the nonlinear functional J{u,v). 
Indeed, the energy functional for solitary waves 

hiu, V) = j {ul + f 2 + ^(^2 + y^) _ ^(y2 ^ ^2)2^ 

after the scale transformation {uq{x)^Vq{x)) = y/q{u{qx),v[qx)) with q > 0, takes the form 

f c? 

h{u,v) > inf /4(m,, V,) = inf / [q'^{ul + vl) + —{u^ + v^) - ^q{v? + v^Y 

R 

> y [q^(ul + vl)-^q(u^ + v'f)dx, (3.4) 

R 

where the conserved mass integrals do not change: ||uq||2 = ||u||2 and ||uq||2 = IK'lb- Using the scaled 
forms of the identities (|3.3p in (|3.4|) . the energy functional takes the form 

/ 3 2fl^ \ -'^Z® ^ 

h{u,v) > M h{u„v,) > - ^'^^-TT/ V' 

q>o \ 16 / mi, J(u,v) 

for which J{uq,Vq) — J{u,v) and X ~ Ii + 12- Thus ground state solutions (uq,Vq), i.e. a minimizer of 
the Hamiltonian is also a minimizer of the functional J{u,v). 



4 Stability of Solitary Waves 

In this section, we are concerned with the stability of solitary wave solutions (|1.2p of system (jl.ip . For 
solitary waves, the appropriate notion of stability is orbital stability. All solitary waves of the same form 
but in different positions through space translation and phase rotation are assumed to be in the same 
orbit. The LSI equations have translation and phase symmetries, i.e. if {4>{x, t), '4'{x, t), w{x, t)) solves 
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the LSI equations, then (e*^i0(x + xq, t), e'^^^ijj{x + xq, t), w{x + xo,t)) solves the same system for any 
xo e M and 61,62 G [0, 27r). We define the orbit 0{f, g, h) of the triplet (/, g, h) as follows: 

0{J, g, h) = {e'^i/(. + xo), e^'^5(. + xq), h{. + xq); 6^,62 G [0, 2^), xq e R}. 

A solitary wave is said to be orhitally stable if, for the initial data being near the solitary wave orbit, 
the solution at all later times remains near the solitary wave orbit. 

The main result of this section is the following theorem. 
Theorem 1. For c > and Au) — c? > 0, solitary wave solution of (|l.ip 



(4.1) 



e*"*^'(a; - ct) = e*"*i?2(a; - ct)e*^^^V^, 

W{x - ct) = -^[Rlix - ct) + Rl{x - ct)], 
is orbitally stable, i.e. for any e > there exists a corresponding 5 > Q such that the initial data 
((/)o,'(/'o,wo) G H'^{M) X i/i(M) X .jvith 

\\M.)~^{.)\\h^ <5, |1V^o(.)-*(-)IIhi <'5, \\wo{.)-W{.)\\2<5, 

imply 

inf ||e'»i0(. + Xo,t)-<i>(.)|Ui <e, 
eie[o,27r) 

inf ||e'^=V(.+a;o,t)-*(.)lki <e, 
e2e[o,27r) 

inf \\w{.+xo,t)-W{.)\\2<e. 

In order to show that solitary waves (|4.ip are orbitally stable, i.e. to prove Theorem 1; we have 
to find an estimate on the distance in iJ^(K) x iJ^(K) between the orbit ©(ij^./ja) of solitary waves 
and the solution {(j){x,t),tlj{x,t)) of the LSI system. The deviation of the solution {(p{x,t),ip{x,t)) 
corresponding to the initial data ((^o,'0o) from the orbit 0(^b.i,R2) of solitary waves is measured by the 
metric 

ei,92G[0,27r) 



where 

+ Nn{e''''e-'^^-+^'>-'''>ij{.+xo,t)~R2). (4.2) 

The norm function Nn in g^) is defined as Nn{f) = QWfWl + ||V/||^ and satisfies min(l,fi) \\f\\%i < 
Nn{f) < niax(l,0) ||/||^i. Perturbations of sohtary waves, denoted by wi{x,t), W2{x,t) and ri{x,t), 
are defined in the form 

wi{x,t) = e''^'e-'^^''+^'>-^'Uix + xo,t) - Ri{x), (4.3) 

W2{x, t) = e'^^e-*^(^+^«-'=*)7/;(a; + xo, <) - R2{x), (4.4) 

r]{x, t) = u{x + xo, t) + - \Rl{x) + Rl{x) \ , (4.5) 
c 

where Wfe(a;, i) = pfe(x, f) + igfe(a;, i) (fc = 1, 2) are complex-valued functions, and •q{x^t) is a real- valued 
function. Here 61,62 and xq will be chosen later where the infimum of is attained. Eq. (j4.2p . and 
(|4.3p - (|4.5p show that we have to find estimates on the norms of wi{x,t) and W2{x,t), and the 
norm of r](x, t). 

The following lemma is a generalization of the one which was proved in the context of the orbital 
stability of solitary waves, by Bona [21] for the Korteweg-de Vries equation and by Angulo and Mon- 
tenegro [22| for the long wave-short wave interaction equations with an integral term. The following 
lemma states that there are 6i = 6i(t) {i — 1,2) and xq — xo{t) such that infimum of Inixo, 61,62) exists 
where the local well-posedness of the Cauchy problem for (jl.ip is used. 

Lemma 2. Let {(j>, tp, u) be a solution of (jl.ip corresponding to the initial data {(po, ipo, uq) E H^(M.) x 
i/^(]R) X L^(R) with the properties II 00 II 2 = 11^1 II 2 and ||?/;o||2 = ||^2||2- Suppose that In{xo,6i,62) < 
n(||i?i||| + ||i?2|li) for some to G [0,r] and some {x^, 61,62) G M x [0,27r) x [0,27r). Then inf{/o|a;o € 
M, 61,62 E [0, 27r)} is assumed at least once. 

Proof. It is clear that In is a continuous function of {xq,6i,62) on R x [0,27r) x [0, 27r). Moreover, 
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for any (6*1, 6*2) G [0, 27r) x [0, 2n), we have 



^ . . , ... ... , , , .12 

Xq — '=pOO 



+ P'l(-)ll2 + P2(-)II2 + 2f^||i?l(-)ll2 + 2f^||i?2(-)ll2, 

= + J)(l|i?l||^ + P2|l^), (4.6) 

where ([53)1 is used. The hypothesis /n(a;o, 6*1, 6*2) < + ||-R2||i) , the continuity of Iq and 

imply the resuh. □ 
We now show that the infimum of Iq is attained at a finite value of xq for some to e [0, T]. For this 
aim, it will suffice to show that /a(xo, 6*1, ^2) < ^^(ll-Rilli + II-R2II2) holds in some interval. Using the 
inequality \\a + b\\l< 2\\a\\l + 2\\b\\l, one can obtain 

Inict,-u;t,-cjt) < 2|10'(.)-0;(-)ll^ + (y + f^)ll<^(-)-</'.(-)ll^ 

+2|lV''(.)-V4(-)ll2 + (y + f^)llV'(-)-^.(-)ll2, 

where prime denotes differentiation with respect to spatial variable x. Solitary wave solutions {4>s,''l's) 
given in (|1.2p are globally defined. Thus, it follows from the continuous dependence theory that, for a 
T > 0, there exists a S > such that if 

||<^o(.) - e'«-i?i(.)|lHi < S, and \\M-) ~ e^*-^2(.)|Ui < S, 

then the solution {(j){x,t),ip{x,t)) corresponding to the initial data {(po{x),ipQ{x)) exists at least for 
< t < T. This solution also satisfies 

\\cb{-,t)-cj,s{-,t)\\m and U{-,t)~i^s{-,t)\\m <e. 

Using this result, we get In{ct, -tut, -ujt) < ^(?(\ +tj). Choosing < ^{\\R^\^\ + |li?2|li)/[4(l 
shows that the hypothesis of Lemma 2 is satisfied at least for (io;^ij^2) — (ct,— cut,— tot), from which 
we get an upper bound for In- 

As a result of Lemma 2, the following compatibility conditions are obtained for the real- valued 
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increment functions Pi{x, t) and qi{x, t) {i — 1, 2) 

j {Rl + Rl)Riqidx^O, (4.7) 

K 

J {Rl + Rl)R2q2dx^0, (4.8) 
J [Rl + Rl) {r,^-^ + d^; = 0. (4.9) 

R 

The relations (14. 7|) . (14. 8|) and ()4.9|) are obtained by differentiating In defined in (|4.2p with respect to 
01, 02 and xo, using system (|1.3p and then evaluating the resulting equations at values (xo, 01,62) which 
minimize /q. Note that 

where e'^ie-'5(^+^o-ct)0(-^ ^_ ^) ^ e''^' A{x + xo,t) = Ri{x) +wi{x,t) and e**2e-*5(=^+^o-c«).(/,(a; + 
a;o,t) = e**2B(x + a;o,i) = R2ix) + W2(x,t). 

We now introduce a continuous nonlinear functional L, called the Lyapunov functional, over _ff"'^(R) x 
H^{R) X L'^{R) in the form 

L{c^,^,u)^u;{h+l2) + ^l3+h, (4.10) 
where Ik {k — 1, 2, 3, 4), given in (|2.4p . are the conserved quantities of system (jl.ip . Thus, the Lyapunov 
functional is invariant with time: AL{0) — AL(t). Our stability result will rely on the inequalities 

AL(0) < 2g{e) 

AL{t) > g{\\wi\\H^) + 9{\\w2\\h^), 

where g{x) — aix^ — a2X^ — a^x'^ for some positive constants (i = 1,2,3), and HtUiHi^i [i = 1,2) is 
the distance between the solitary wave ($, ^E*) and the solution {(j>,4') of (|l-ip . To find the bounds, we 
calculate AL{t) 

AL{t) = L{ct){x,t),i^{x,t),u{x,t))-L{^{x),-^{x),U{x)), 

= L {^{x) + e'"^ wi{x,t),-^{x) + e'"^ W2{x,t),U{x) + ri{x,t)) 
-L{<^{x),-^[x),U{x)). 
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Expanding the functional L near (<I>, 4') yields 



(4.11) 



where SL, 6^L and S^L are the first, second and third variations of L, respectively; and all variations 
higher than third order are zero. The explicit forms of variations are given as 



SL = j2{[Ri^,,-nRi+j{Rl + Rl)Ri]pi 

R 

+ [R2^xx - ^R2 + i{Rl + Rl)R2] P2) dx, 



2,2 I 2 I 2 I 2 I 0/ 2 I 2 I 2 I 2\ 
2^1 + Pl.x + <ll,x + P2^x + q2.x + ^(Pl + Ql +P2+I2) 



+2/3{Ripi + R2P2)v - l{Rl + Rl){pi +ql+pl+ <?!)] dx, 
5^L = I (3{pI + ql+pl + ql)ri dx, 



(4.12) 

(4.13) 
(4.14) 

where the relations <i>(.T) = Ri{x)e^ , *(x) = R2{x)e^ , W{x) = - (3'^ {R\{x) + RI{x)) / c, and Wfc(x) = 
Pk{x) + iqk{x) {k = 1, 2) are used. Because (i?i, i?2) is a solution (II. 3p . the first variation (14.121) vanishes. 
Thus (i?i,i?2) is also a critical point of the Lyapunov functional L. From eqs. (|4.13|) and ()4.14|) . we 
have 



AL(t) = {Loqi,qi) + {Loq2,q2) + {Lipi,pi) + {L2P2,P2) +2{L3pi,p2) 
1 
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+ +P2 + qir + '^{pi + qt+P2 + q2){piRi +P2R2 



2 

2/3 

77 + — (pii?i +P2R2) + -ipi + qi+P2 + qi) 



dx 



dx, 



(4.15) 



where the operators Li {i ~ 0, 1, 2, 3) are defined as 



Lo 

L2 



dx^ 
dx^ 



n-^{Ri + R'^), Li 



dx^ 



n - 7(3i?? + Rl) 



n--i{Rl + iRl), L3 = -27i?ii?2. 



We use the following lemmas to find a lower bound for AL(i). 
Lemma 3. There exist positive constants d {i = 1,2) such that 

{Loq^,q^) >C,M\]J^ (^ = l,2). 



(4.16) 
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Proof. It should be noted that LgRi — and Ri > {i = 1,2). Therefore Lq is a non-negative 
operator, i.e. fii — mI({Loqi, qi) / {qi, qi)) > {i — 1,2). If the infimum of the functional fii subject to 
the constraints (|4.7[) and (|4.8p is zero then it is attained at qi{x) — Ri{x). This contradicts to the above 
constraints, thus fii > (i = 1,2), i.e. 



{Loq^,q^) = -^\\q^\\~JJ{Ri + Ri)qtdx + ^-^\M >a\Mi (* = 1,2) 

where \\qi\\ = |lV(7i|l| + r^HgiHj, h and Ci are some positive constants. If ki < Ci/{2jE'^) where 
E — max(||i?i||oo, ||^2|loo), then we have + 1) ^ 7 J{Ri + -RD^i^^; > 0, and consequently 

R 

where d = h min(l, fi) /{h + 1). □ 

To find a lower bound for the expression {Lipi,pi) + (£2^2,^2) + 2(L3pi,p2) in ()4.15|) is more difficult 

than that of {L^qi^qi). We will use the facts that (i?i,i?2) is the minimizer of the functional J{u,v) 

and that the expression {Lipi,pi) + {L2P2,P2) + 2(^3^1,^2) is associated with the second variation of 

J{u, v). First we prove the following lemma which is a generalization of the one given in [23j . 

Lemma 4. inf {{L,f, /) + {L^g, 9) + 2{L^f, g)) = 0. 
(/.-Ri)— 

(9,-R2)=0 

Proof. Recall that (i?i,i?2) is a minimizer of the nonlinear functional J{u,v). Thus S^J > near 



i?2). The second variation of the functional J is of the form 



— J(i?l + £7^1, i?2 + e??2) |e=0 = + (-^2'72,'72) + 2(L3'7l,??2)) 



2fi 

+-r((-^i' + (^2, V2)){{Ri,x, m,x) + {R2,x, V2,x)) 
a 

-— r;i,,) + (i?2,., ?72,x))' > 0, (4.17) 

where = [277V(^^^d^)]^^V(4\/2), and d = / (w^ + w2)dx. It should be noted that eq. dO]) and 
Pohozaev type identities given by (|3.3p are used in obtaining (|4.17p . 

If the increment functions are chosen as r/i = / and r\i — g with the properties {f,Ri) — and 
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[g^ R2) = 0, then it follows from (|iT71) that 



{L^f,f) + {L^g,g)+2{L^f,g) > 0. 



(4.18) 



Moreover, the functions Ri^x and R2.X satisfy 



+ L^R2,x = + ^Ri - i{Rl + Rl)Ri)^ = 0, 

i2i?2,x + i3i?l,x = {-R2.XX + nR2 - j{Rl + Rl)R2)^ - 0. 



(4.19) 



As a result of (|4.19p we find 

{LlRl^x, Rl,x) + {L2R2,x, R2,x) + {L^Rl^x, R2,x) + {L3R2,x, Rl,x) 
= {LlRl.x + LzR2,x, Rl,x) + {L2R2,x + L^Ri^x, R2,x) = 0, 

which shows that the infimum of (|4.18p is assumed at {Ri.x, R2,x)- Because / — Ri,x and g — i?2,a: 
satisfy the hypothesis of the lemma, we get (/, Ri) = {Ri.x, Ri) = and (g, R2) ~ (R2,x, R2) = 0. This 
completes the proof. □ 
In order to find a lower bound for (Lipi,pi) + (^2^2,^2) + 2(^3^1,^2), we require that the perturbed 
solution has the same L^-norm as the solitary wave, as given in the hypotheses of Lemma 2, 



where definitions (|4.3p are used. The restrictions (|4.20p will be relaxed later and the stability of solitary 
waves will be proved with respect to general perturbations. To this end, we assume that the real parts 
of the increment functions, Pi{x, t) [i = 1, 2), will be of the form pi = pj|| -\- Pi±_ where 



||</'||2 = |li?l||2, ||V^||2= ||i?2||2. 



(4.20) 



Conditions (|4.20p give rise to the following constraints 



{R^,P^)^--[{p^,P^) + {q^,q^)]^--\\w^\\l <0 (^-1,2), 



(4.21) 




R^ 



'I 1 



P'i± = Pi - 




Ri- 
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This gives rise to {pi±, Ri) =0 (i = 1, 2). Using the decomposition of Pi{x, t) {i = 1, 2), we have 

{LlPl,Pl) + {L2P2,P2) +2(^3^1, _P2) 

= {Lipij_,pi±) + (L2P2±,P2±) + 2{L3Pij_,p2±) 

+ {LlPl\\,Pl\\) + {L2P2\\,P2\\) + 2(i3Pl||,P2||> + 2(LlPl_L,Pl||) 

+ 2{L2P2±,P2\\) + 2{L3P2l,Pl±) + 2{L3Pil,p2±). (4.22) 

To find a suitable lower bound for {Lipi±,pi±) + {L2P2±,P2±) + 2(L3Pi^,p2±) using Lemma 4, we 
further assume that (pi, II2 = {p2, R2)/\\R2\\2- 

Lemma 5. There exist positive constants C3 and C4 such that 

{LipiJ_,piJ_) + (L2P2±,P2_l) + 2{L3Pi±,p2J_) 

> CsilMl + IMl) - C,{\\w,rm - WM'm)- (4-23) 
Proof. If / — pi± and g ~ P2± then the hypotheses of Lemma 4 are satisfied by pi± and P2±- That is, 

{Lipi±,pi±) + {L2P2±,P2±) + 2{L3pi±,p2±) > 0. (4.24) 

The infimum of (j4.24p is zero. This infimum is attained at (pi_l,P2_l) = iRi,x, R2.x)- In such a case, for 
the increment functions pi — aRi + Ri^x {i — 1,2) where a = {pi^Ri) /\\Ri\W (i — 1,2), the constraint 
(|4.9p reduces to 

I J [{Rj + Rl)%dx + j{R\ + Rl){RiRixx + R2R2xx)dx = 0, 

R R 

j {[{Rl + RDxf + 2{Rl + Rl)[{Ri,xf + {R2.xf]] dx = 0, 

R 

where integration by parts is used. This result leads to i?j = (i = 1, 2) which contradicts positivity of 
ground state solutions (i?i,i?2)- Thus there exists a positive constant C3 such that 

{Lipi±,pi±) + {L2P2±,P2±) + 2(L3pij_,p2±) > C3. (4.25) 

Moreover, using {pi±,Pi±) = {Pi,Pi) - [(Pj,Pi) + {qi, qi)f I (4||i?i||2), the inequality (14. 25^ can be arranged 
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to yield 



+ {L2P2±,P2±) +'2{L3Pi±,P2±) > C3{{pi±,pi±) + {P2±,P2±)), 

= L-a IIP1II2 + \\P2\\ 



V 4||i?i|li A\\R2\\l)' 

> CsiWpiWl + \\P2\\l) ' C,{\\W,\\%, + \\W2\\%^1 

where continuous embedding of H^{M.) in L'*(M) is used, and C3 and C4 are some positive constants. 
This completes the proof of Lemma 5. □ 
Lemma 6. There exist positive constants C5 and Cq such that 

(Lipi||,pi||) + (L2P2||,P2||) + 2(L3Pi||,P2||) > -C5\\wi\\%i - Ce\\w2\\U. (4.26) 

Proof. Recall that {LiRi.Ri) = —2^{Rl,Rf) [i — 1,2). Firstly, using — aRi {i — 1,2) where 

a = — ||u'i||l/(2||-Ri||2)' obtain 

(izK||,P.||)=a'(i»i?z,i?z) = -^|^ \\w^\\t> ~Ci+4w,\\\j, (z = l,2), (4.27) 

where and Cq are positive constants. Secondly, using Sobolev embedding and Young's inequality 
ah < dP Ip + \fl I q with p = q = 2 , we obtain 

(i3Pl||,P2||) - - J |j^;^2^'j^'||2 Il«^lll2 11^211^ > (ll^lir^,. + ||u;2|1^hO ' (4-28) 

where Cj is a positive constant. (I4.26P follows from (|4.27p and (|4.28p . □ 
Lemma 7. (L3Pi||,p2±) = and (£3P2||,Pi±) 0. 

Proof. Using the definition of the operator L3, we have (i3Pi||,P2±) = ^ 27Q!(i?2Pi-L> ^i)- Then 

|(i3Pi||,P2i)| < |27a|i?2|(pi^,i?i)| = (4.29) 

and, similarly 

l(^3P2|l,PiJ-)| < \2^a\E\p2A.:R2)\ = 0. (4.30) 
This completes the proof. □ 
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Lemma 8. There exist positive constants Ei and Fi {i — 1,2) such that 

'2{L,p,±,P^i)>-E,\\w,\\l,^F,\\w,\\%, (i = l,2). (4.31) 

Proof. For the terms {LiPi±,pij), we find 

(i,p,^,p,||)=a((i?,,,,m,,)-37(i?f,m)-7(i?2i?„p,^)), {1,3^1,2 i^j), (4.32) 

where a = -\\w,\\l/ {2\\R,\\l), < E^\{R,,p,i_)\ - 0, and < E^\{R,,p,i_)\ = 0. 

Using pij^ = Pi — aRi and the Cauchy-Schwartz inequahty in (j4.32p . we have 

{LiPij_,pq) > ~ 2||j^.||2 (-^'^^'P'.^/ ~ 4||j^.||4 

^ ||-Ri,x||2 II ||2 II II ll^i,2;||2 n ||4 /■ i n\ 

- - oil P 112 Il"^'ll2 ll^'^^lla - .|| n 114 I|W»||2 (« = 1,2). 

By continuous embedding of H^(M.) in i^(K) the resuh fohows 

{L^p^A.,p^\\) > -y ||m,||?,, - y||m,||^, (z = 1,2), 

where Ei and i^^ are some positive constants . □ 
Lemma 9. There exist positive constants Ai (i = 1, 2, 3) such that 

{Lipi,pi) + {L2P2,P2) +2{L3Pi,p2) > ^1 (llPlllffi + ||l52||^i) 

-A2 {\\w,\\j,^ + \\w2\\l^) - A, {\\w,\\%^ + \\w2\\%^) . (4.33) 

Proof. By direct computation, one can see that 

{Lipi,pi) + (L2P2,P2) + 2{L3Pi,P2) 

^-1 j [{Rl + RI){pI+pI) + 2{RiPi + R2P2f]dx 

R 

+ lbi|| + l|P2|l, (4.34) 
where \\pi\\ = ^\\pi\\l + |1 Vp^H^ {i = 1,2). On the other hand, combining the inequahties (|4.23p . (|4.26p . 
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(HSU), and (|i3T1) . we obtain 



(LlPl,Pl) + (i2P2,P2) +2(L3Pi,P2) > (^3(11^1112+11^2112) 



-Cs\\wi\\%,-C4w2\\%., 



where Cs — C\ + C5 + Fi and Cg — + Ce + F2 are positive constants. 

Using (|4.34p and (I4.35p . for a sufficiently small positive number m, we find 

I = ^T(bi|| + IIP2II) - 7 / ml + RlM +pI) + 2(i?iPi + R2P2f]dx 
m + f J 

> CliWpiWl + ||P2||^) - A2{\\W^\\1, + \\W2\\%^) - ^adklll^^i + \\W2\\%1) 

> -A2i\\wi\\%, + \\w2\\h) - M\\M%^ + 



(4.35) 



(4.36) 



where -7 /[(i?? + ^2)(p2 _^p2) _^ 2{RiPi + R2P2f]dx > -6jE^{\\pi\\l + ||p2||i) is used, and Ci = 

R 

(C3 — 6^mE^)/{m + 1), ^2 = max(i?i, i?2)/(™ + f) and vis = max(C8, C9)/(m + f) are positive 
constants. Recalling that {Lipi,pi) + (£2^2,^2) +2(i3Pi,p2) = ^ + »7i(l|pi|| + \\P2\\) / (m + 1) we obtain 



(|4.33p where Ai = TOmin(l, + m). This completes the proof of the lemma. 

Finally, the integral term in (|4.15p can be estimated as 

■f 



□ 



-7 



[Pi +ql+P2 + T2) + 2(K + qi+pi+ qi){piRl + P2R2 



< Di\\wi\\Hii\\wi\\]ji + \\w2\\hi) 

+ D2\\w2\\m{\\wi\\Hi + \\w2\\hi) + 7l|ti'l|l4 + 7ll''«2||4 

< Di\\wifH^ + D2\\w2fHl + D3\\wi\\jj, + D4W2\\%1, 



dx 



(4.37) 



where continuous embedding of i/^(M) in i*(R) and in L°°(M) and Young's inequality ah < aP/p + 
b'^/q with p = 3 and q ~ 3/2, are used, and Di {i — 1, 2, 3, 4) are positive constants. 
Proof of Theorem 1. Combining the inequalities (|4.16p . (|4.33p and (|4.37p . an upper bound for AL is 
given in terms of norms of the increment functions Wi as follows 



AL{t) > g{\\wi\\H^) + g{\\w2\\H^), 



(4.38) 
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where g{x) — aix^ — a2X^ — aj,x'^ with positive constants 

«! = min(Ci,C2,^i), 02 = ^2 + niax(i?i, 1)2), as = A3 + max(i?3, 1)4). 

Because ^(0) = and g{x) « aix"^ near x = 0, there exists a positive number e, < e < eo, such that 
g{x) increases on [0, eo]. For such an e, the inequahties 



for sufficiently small 5. As L{t) is invariant with time, i.e. AL{t) = AL(0); from (|4.38p . we have 



By continuity of the function g, there is at least a number e < ei < co such that 

< ei < cie and |1w2(<)|1hi < ei < C2e, 

where t e [0, 00) and q {i — 1, 2) are positive constants. 

Finally for the increment ri(x,t), we have to prove that ||77(i)||2 < ce using the results obtained for 
||wi(t)||/fi and ||w2(i)||ffi . In ()4.38|) we have shown that 



\\M-)-H-)\\m <s, \\w2m\m 



\\M-)-'^i-)\\m<s, 



imply that 



AL{0) < g{e) + g{e) 



g{\\wi{t)\\H^)+g{\\w2mH^) < AL{t) = AL(0) < .g(e) + g{e). 




> g{\\wi{t)\\H^)+g{\\w2{t)\\m) 




where 



K = {Loqi,qi) + (^092, 92) + (Lipi,pi) + (^2^2,^2) + 2(^3^1,^2) 
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2 (Pi +ql+pl + (il? + ^ipl + qi+pl + ql){piRi + P2i?2) dx 
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For a given e > with < e < eqi the function g is increasing and g{\\wi(t)\\Hi) > for ||wi(i)||/fi < 
CiE (i = 1, 2). This shows that K > Q. By the invariance property of the functional L, AL(t) = AL(0), 
we have 

f \ 20 3 
/ V+—{PiRi+P2R2) + -{pl+ql+pl+ql) 

i 

Using the inequahties (a + 6)^ > — and (a + fe)^ < 2{a? +5^), we find 

Il^/Wll2 < \9{e) + C,{\\wm?H^ + \\^2{tWH^)+CA{\\w,{t)\\%^ + \\w^{t)\\l^)^ (4.39) 

where the embedding of ff^(R) into L^(R) and L^(R) is used, and C3 and C4 are positive constants. 
For some c > 0, we have ||?7(t)||2 < ce. Thus we have proved that sohtary waves {cj)s,ips,Us) p.2p are 
orbitally stable with respect to the small perturbations preserving the norms. 

In order to prove stability of solitary waves with respect to general perturbations, we consider a 
solitary wave solution {Qm, Q2n) which satisfy the system (|1.3p 

g'/o - nQui + liQln + Qln)Qin - 0, 
g'so - ^Q2n + 7(Q?n + Qln)Q2n = 0, 

where ||0o||2 ^ IIQ10II2 and HV'olb 7^ ||Q2f2||2- Then, the functions Pi{x) = Q.in{x/V^)/y/n {i = 1,2), 
satisfy 

Pi' - Pi + 7(Pf + Pi)Pi = 0, 

P2 -P2 + i{Pi + Pi)P2 = 0, 

where ||Pi||2 = WQinh/y^ (i = 1,2). Thus, for the solution (Qioq,Q20q) corresponding to Qq > 0, 
we have ||-Pj||2 = ||Qif2o II2/ v^o- It is possible to choose Qq such that ||0oll2 = IIQ1O0II2 and \\ipo\\2 = 
|jQ2J2nll2- In the proof of stability of solitary waves (Qin, Q2n) relative to general perturbations that do 
not preserve norms, assuming the initial data obey the inequalities ||0o(-) ^ Qin{-)s^\\H^ ^ ^ and 
IIV'o(-) — Q2o(-)s~ ll-ffi — ^ I the idea is to apply the preceding stability theory for (QiOojQ20o) and 



dx < -5(e)- 
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then to use the triangle inequahties 

\W'>'c^{. + Xo,t)-Q^n{y*\\H^ < ||e'^V(-+a;o,t)-QiOo(-)e'^IUi 

+ \\Qin„{.)-Qin{.)\\H^, (4.40) 

\\e'^'^{. + xo,t)-Q2n{.)e'^\\m < V'^'H- + xo,t) - Q2noi-)e^^\\m 

+ \\Q2n„i.)-Q2ni.)\\m- (4-41) 

The first terms in the right hand side of the inequalities (|4.40l) and ()4.4H) are bounded from above 
by the orbital stability of the solutions (QiOojQzOo)- It remains to determine 6 and to show that 
||Qir2o ~ Qiiillffi {i ^ lj2) are also small. From the definitions of Qi^ and Qin^ we have 

+Vn^ J I Plix) - ^ PU^ x)\'dx {^ = 1,2). (4.42) 
Using the inequality (a - eb)'^ < 2e^(a - b)^ + 2(1 - e)'^a'^, (|4.42p is rewritten as 

I p,{x)~ p^ur-i^ x)\^dx 



\ R 



-(^-1)^ / Pf{x)dx 



+ 2^/^F^g j\Pl[:,)-Pl[^^)\-dx 

\ R 

+ (^-ir/ {Pl{^)?dx\. 

M / 



(4.43) 



Following the results of Angulo et. al. [2¥, obtained in the study of the stability of solitary waves in 
the critical case for a generalized Korteweg-de Vries equation and a generalized NLS equation, an upper 
bound for (|4.43p can be given as follows 

\\Q^i-^,-Q^n\\H^ < H/fk) - + - VUf {^ ^ h 2) , 

where the fundamental theorem of calculus and Minkowski's inequality are used, and the positive con- 
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stants Gi and Hi (i = 1, 2) are given as 



Gi = iWxPlwl + noWxPi'wl) , Hi = ^ (mwl + {Vno + Vnr\\p;\\i) . 

We now show that there exists a positive constant C = C{flo, Pi) such that Iv^Oq — < C5 at least 
for small values of 5. Using the results 



llOioJIi _ ll^oll^ _ ll^oll^ 



l^illi 



\pi\\i \\P2\\r 



we have 



iPi IP 

-•12 



\\M-m-\\Qin{.)e'^\\l 



< 



^ (^ll'^o(.)ll2 + (1 + l)\\M-) - Qio(.)e^ 



I2 ) ) 



where the inequality |||a||^ — < ||a — + 2||a||||a — 6|| and Young's inequality are used. Using 

\\M-) - Qin{.)e'^\\l < 6^ and ||</>o||i = we have 

IK1II2 ^ ^ 
where C{^lo,P^) = ^/^^ + 2/\\Pi\\l The inequality \Vn^ - VU\ < C6 implies 1^^- < DS for 
some positive constant D. This completes the proof of Theorem 1. 
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